PSEUDO-BJT BASED RETINAL FOCAL-PLANE SENSING SYSTEM 
BACKGROUND OF THE INVENTION 

1) FIELD OF THE INVENTION 

The invention relates to an optical sensing system, in particular, a retinal 
5 focal-plane sensor chip that is structured on Pseudo Bipolar Junction Transistor 

(Pseudo-BJT) and comprises a system with an adaptive current Schmitt trigger and a 
smoothing network for optical image detecting circuits, such as image identification, 
image tracing, robot vision readers of image, barcode or character, etc, 

2) DESCRIPTION OF THE PRIOR ART 

10 Rapid development of science and technology has made the semi-conductor 

and IT industries continuously rising and flourishing, resulting in outstanding 
changes in considerable application fields. Such changes not only make achievement 
of science and technology, but also improve our quality of life and alter our patterns 
of life. Since 1980, the researches in silicon retina have been developed one after 

15 another emphasizing how to attain the H cell function by circuits applying Gaussian 
smoothing to signals. How to enable retina and cerebrum visual functions to be 
performed by silicon chip has become a great challenge in recent years. In the event 
that silicon retina and silicon neural network can be developed, human visual system 
functions or its partial functions can be attained in electronic systems to greatly 

20 enhance the capability of instant image processing system and further be applied to 
the fields of image recognition, image tracing and robot vision. 

An organism's retina is an excellent instant image sensing and front-end 
processing system with the advantages of high dynamic range and instant image 
processing, hence, more and more R&D people are attracted to research the 

25 possibility of using IC for realizing the retina function. 



Among those researches, the most attractive structure was Resistor Network 
proposed by Caver Mead. The structure employed photo bipolar junction transistor 
(PBJT) to convert light into electric signal and simulate the sensitization of P cell. 
Subsequently, the signal is implanted into the Resistor Network generating similar 
5 Gaussian smoothing signal for simulating the H cell function. Consequently, both 
signals subtract each other obtaining a B cell signal. The Resistor Network in this 
structure is only composed of megaohms resistance; however, a large resistance still 
occupies a larger chip area during the Integrated Circuit(IC) design. Even though 
there have been various researches and methods for improving the drawback 

10 mentioned above, nevertheless, the chip area of silicon retina of Resistor Network is 
still too large. In addition to the above drawbacks of Resistor Network, there are two 
problems while PBJTs are applied : (1) the chip area is large when BJT-based retinal 
sensor is manufactured; (2) the PBJTs have smaller current gain when the technology 
scales down to 0.25um or below. In view of the drawbacks and problems 

15 mentioned above, it is obvious that BJT-based technique is not suitable to be applied 
in the future manufacturing and optical applications. 

SUMMARY OF THE INVENTION 

In view of the foregoing, the present invention employs a unique neuron 
bipolar transistor to simulate partial retina functions forming a silicon retina chip 

20 with very tight structure and the functions of tunable image-averaging and detecting 
moving objects. At present, researches on organism's retina have the latest 
development that signals from retinal cell can be detected. Therefore, the objective 
of this invention is to apply the latest research of current retinal cell signals to rectify 
relevant circuit structures for achieving more retinal functions. In addition, following 

25 the front-end process of the silicon retinal chip, the back-end process is to make 



higher level images forming a complete vision system. The invention focuses on 
moving objects processing and further utilizes the neural network for realizing 
instant image processing system. This invention is designed to make great 
contribution to four fields: 
5 Firstly, the invention is applicable to optical sensors, such as 

bar-code/character readers, by employing the design of the silicon retinal circuit 
structure. The high dynamic range characteristics of utilizing the silicon retinal 
circuit structure enables an optical sensor to be operated under less-lighting 
environment without applying additional illuminant In addition, a silicon retinal 

10 circuit has the contrast enhancement characteristic that inputted gray-scale images 
can be enhanced and outputted as black/white images, thereby effectively reducing 
imaging data size and enabling the optical sensor to be suitable for the application of 
instant image processing. Therefore, the optical sensor is suitable for 
bar-code/character readers. 

1 5 Secondly, the research of retinal cell signal can be eventually developed 

toward implanted silicon retinal chip helping the blind to regain eyesight. Thus, 
such research shall be a significant breakthrough in the biology and medical science 
fields. 

Thirdly, the newest silicon retinal structure can be utilized for designing 
20 highly accurate motion sensing chip. This design has high value in either national 
defense industry or light industry for daily life. 

Moreover, the newest silicon retinal structure can be used for cooperating with the 
image processing circuit in the back-end neural network to form an instant image 
processing System-on-Chip. Such design is also important to national defense 
25 industry and light industry for daily life. 
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In view of the foregoing, this invention proposes a Pseudo-BJT based retinal 
focal-plane sensing system for resolving the above problems, comprising the 
following technical characteristics: 

A. the silicon retinal structure of Resistor Network applies MOSFET to 
replace electric resistance that occupies larger area. 

B. the current gain of this invention is designed according to various 
requirements through the proportions of parameters of geometrical patterns resulting 
in adaptive variations, without being restricted within the manufacturing 
requirements; whereas the current gain of BJT-based optical sensor is limited to the 
manufacturing requirements. 

C. the chip area of a Pseudo-BJT based retinal sensor is smaller than that of a 
photo bipolar junction transistor based (BJT-based). 

D. this Pseudo-BJT technique is suitable for general CMOS manufacturing 
process. 

In addition, this invention comprises the following modules and units : Row 
Decoder, column Decoder, Pixel Array Module and Data Buffer for achieving the 
aforementioned objectives. 

To enable a further understanding of the structural features and 
the technical contents of the present invention, the brief description of 
the drawings below is followed by the detailed description of the 
preferred embodiment. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is the architecture of the proposed retinal focal-plane sensor 
chip of this invention. 

FIG. 2 is a block diagram of counter for selecting external or internal 



row and column addresses. 

FIG. 3 is an adaptive current Schmitt trigger of proposed retinal 
focal-plane sensor of this invention. 

FIG. 4 is a pixel structure of proposed retinal focal-plane sensor 
5 circuit of this invention. 

FIG. 5 is a smoothing function for induced photocurrent of this 
invention. 

FIG. 6 is an inputted pattern-A with noise. 

FIG. 7 is a 32x32 pixel output (Retina_out) of 2D retinal focal-plane 
10 sensor for input pattern-A with adaptive current Schmitt trigger and 
smoothing network. 

FIGS. 8-a and 8-b are dc output characteristics of adaptive current 
Schmitt trigger of this invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
15 This invention proposes a Pseudo-BJT based retinal focal-plane sensing 

system, which is a system with instant image sensing and front-end processing 
having the advantageous features of high dynamic range and instant image 
processing, etc. The invention is suitable to be applied in optical sensors, such as 
bar-code/character readers. This invention has the following features: 
20 Firstly, Adaptive current Schmitt trigger of the invention can be adjusted adaptively 
according to the value of induced photocurrent, which enhances noise immunity and 
eliminate noise disturbance. The proposed Pseudo-BJT focal-plane sensor circuit is 
operated in the subthreshold region. Therefore, the total power consumption of this 
invention is far less than that of BJT-based retinal sensor circuit. The noise 
25 disturbance sometimes misled the retinal sensor, that is, the sensor mistakes an 



unreality for a detected object owing to the impact of noise disturbance, thereby an 
adaptive current Schmitt trigger is used for eliminating the impact caused by noise 
disturbance. FIG. 3 shows the adaptive current Schmitt trigger of proposed retinal 
focal-plane sensor of this invention that a current hysteresis AI is the quality of the 
5 current Schmitt trigger in which the input threshold changes as a function of the 
input current level. Adding current hysteresis in the retinal sensor circuit could 
enhance the function of photocurrent noise immunity and eliminate noise 
disturbance. 

Secondly, the value of an electric resistance generated by the Pseudo-BJT 
10 Based smoothing network can be changed according to external bias circuit with the 
function of eliminating noise disturbance. The actual consumed area of the 
invention is far less than that of Resistor Network. The main function relating to 
the H cell has the function of Low-Pass Filter. Therefore, the value of an electric 
resistance can be changed according to external bias circuit, thereby resulting in 
1 5 different high frequency noise to be eliminated, having higher tunable capability 
comparing with electric resistance of the past. 

A preferred embodiment of the invention is illustrated herein by the technique 
mentioned above. Refer to FIG. 1, the architecture of the proposed retinal focal -plane 
sensor chip of this invention is depicted as follows. 

20 The invention uses the image sensing principle of human's retinal cell for 

realizing it by unique chip design thereof. Real retinal detecting cells can be 
divided into three kinds of functions : a Photoreceptor cell (P cell) is to do 
photo-input sensing lacking the function of eliminating noise disturbance; a 
Horizontal cell(H cell) is to smooth an image retrieved by P cell with the Low-Pass 

25 Filter function enabling partial high frequent noise to be eliminated; and a Bipolar 



cell(B cell) is to balance both outputs of P cell and H cell to attain edge detection and 
have the function of eliminating noise disturbance, i.e., the front-end image 
processing system. The retinal focal-plane sensor mimics the functions of the three 
cells in a single pixel for performing major functions in image processing. 
5 The Pseudo-BJT based retinal focal-plane sensing system of this invention comprises 
the following modules and units: 

A Row Decoder 10 is used for detecting external images, randomly selecting 
desired pixel and generating a row address; 

A column Decoder 20 is used for detecting external images, randomly 
10 selecting desired pixel and generating a column address; 

A Pixel Array Module 30 is used for reading pixels and detecting external 
images, in addition, pixel voltages appointed by the Row Decoder 10 and the column 
Decoder 20 are outputted one by one. A voltage is generated when an image signal is 
received by the row address and the column address; Pixel Array Module 30 is able 
15 to accurately detect external images through the adaptive current Schmitt trigger; and 

A Data Buffer 40 is to convert the parallel data to serial data in order to 
reduce output pins of the chip. 

The Row and Column Decoders are able to randomly select desired pixel. 

Each pixel has the functions of a retinal focal-plane sensor, an adaptive 
20 current Schmitt trigger and smoothing network, thereby consisting of a 32x32 Pixel 
Array Module. 

In addition, the internal motions of the retinal focal-plane sensor are 
described as follows, 

First of all, an image is presented on the 32x32 Pixel Array Module 3, 
25 light-induced outputted voltage goes to High and dark outputted voltage goes to Low, 



each pixel voltage on the 32x32 array is outputted. Pixel voltages appointed by the 
Row Decoder 10 and the column Decoder 20 are outputted one by one. At last, the 
Data Buffer 40 converts the parallel data to serial data in order to reduce output pins 
of the chip. 

5 FIG. 2 is the block diagram of counter for selecting external or internal row 

and column addresses depicted as follows. 

Each pixel data of the 32X32 array in FIG. 2 has to be read and a 2-D 
Counter 60 is to produce total addresses for all pixels continually for the Row 
Decoder 10 and the column Decoder 20 to process. Therefore, the Row Decoder 10 

10 and the column Decoder 20 are able to appoint pixels one by one enabling the pixels 
to output voltages thereof. For some of special applications, it would be randomly 
accessed the output of desired pixels by external addresses. Nevertheless, each 9x9 
pixel output requires an External Random Access 70 to appoint external addresses 
for a COUNTER SELECTOR to select internal or external row and column 

1 5 addresses. Subsequently, a Multiplexer 80 is to provide the addresses for the Row 
Decoder 10 and the column Decoder 20 to process. 

The pixel structure of proposed retinal focal-plane sensor circuit of this 
invention in FIG. 4 is depicted as follows. 

The new retinal pixel circuit comprises a Photodiode DO, two Pseudo-BJTs, four 
20 adjustable N-channel MOS resistors of the smoothing network as Msl-Ms4, a set of 
adaptive current Schmitt trigger comprising Mnfl-Mnf2 and Mpfl-Mpf2, an Inverter 
comprising transistors Mn and Mp, and row and column controlled switch 
transistors. 

FIG. 4 shows that Mpl and MP2 are P cells composing a PNP Pseudo-BJT; 
25 Mnl and Mn2 are H cells composing a NPN Pseudo-BJT; where the B cell balances 



both outputs of P cell and H cell on the circuit connection, thereby Pseudo-BJTs and 
pixel areas are reduced. Photoreceptor cell (P cell) is to do photo-input sensing 
lacking the function of eliminating noise disturbance; a Horizontal cell(H cell) is to 
smooth an image retrieved by P cell with the Low-Pass Filter function enabling 
5 partial high frequent noise to be eliminated; and a Bipolar cell(B cell) is to balance 
both outputs of P cell and H cell to attain edge detection and have the function of 
eliminating noise disturbance 

The detailed flow of the circuit is as follows: 

(1) DO is detected and photocurrent is then generated, incorporating Mpl and 
10 MP2 for the P cell to process. 

(2) Mnl and Mn2(H cell) are used for incorporating with smoothing network, 
Msl-Ms4 to activate the image smoothing function; the electric resistance of four 
MOS resistors is controlled by the gate voltage Vsmooth(VF) with the Low-Pass 
Filter function enabling partial high frequent noise to be eliminated. 

1 5 (3) Mp2 and Mn2 have the connection between thereof activating the B cell 

functions. 

(4) Mnfl-Mnf2 and Mpfl-Mpf2 are composed by the adaptive current 
Schmitt trigger for eliminating noise disturbance. 

(5) an outputted Inverter converts analogue signals into digital signals. 

20 (6) the Row and Column controlled switch transistors are controlled by the 

Row and Column Decoders, thereby only appointed pixels are able to output signals 
(Retina_out). 

FIG. 5 is the smoothing function for induced photocurrent of this invention. 
FIG. 5 shows the different smoothing voltage(VF). If the incident lighting were 
25 larger, the photodiode of retinal sensor would induce bigger current. The resistance 



of smoothing network is able to be smaller because of the suitable scale of voltage 
variation in the smoothing network, i.e., various low-pass filter effects. In other 
words, if the smoothing range is in smaller, the image can not be very perceptible as 
it belongs to GLOBAL IMAGE; on the contrary, the image can be very perceptible, 
5 such as hollow eye, as it belongs to LOCAL IMAGE. The above functions, 
GLOBAL IMAGE and LOCAL IMAGE, are essential requirements. 

FIG. 6 is the inputted pattern-A with noise and FIG. 7 is the 32x32 pixel 
output (Retina_out) of 2D retinal focal-plane sensor for input pattern-A with adaptive 
current Schmitt trigger and smoothing network. The details are described as follows. 

10 FIG. 6 shows the inputted pattern-A with noise to be inputted into the 32x32 

pixel array. Each pixel has the circuits of the retinal focal-plane sensor, the adaptive 
current Schmitt trigger and the smoothing network operating for outputting the 
results as shown in FIG. 7, the voltage in light environment is high(3.3V); whereas 
the voltage in dark environment is low(0 V). 

15 FIGS. 8-a and 8-b are the dc output characteristics of adaptive current 

Schmitt trigger of this invention. 

If the induced photocurrent is bigger, the current AI could be adaptively 
adjusted without external controlling voltage, the adaptive current Schmitt trigger 
can enhances noise immunity and eliminate disturbance. 

20 The adaptive current Schmitt trigger can be also used to perform similar 

functions as general circuit hysteresis; the smoothing network can be roughly 
replaced with general resistance circuit. 

It is of course to be understood that the embodiment described herein is 
merely illustrative of the principles of the invention and that a wide variety of 

25 modifications thereto may be effected by persons skilled in the art without departing 



from the spirit and scope of the invention as set forth in the following claims. 
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